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Abstract 

We prove that the exponent of the entropy of one dimensional projec¬ 
tions of a log-concave random vector defines a 1/5-seminorm. We make two 
conjectures concerning reverse entropy power inequalities in the log-concave 
setting and discuss some examples. 
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1 Introduction 

One of the most significant and mathematically intriguing quantities studied in 
information theory is the entropy. For a random variable X with density / its 
entropy is defined as 



( 1 ) 


provided this integral exists (in the Lebesgue sense). Note that the entropy is 
translation invariant and S{bX) = S{X) -|- In |6| for any nonzero b. If / belongs to 
Lp(M) for some p > 1, then by the concavity of the logarithm and Jensen’s inequality 
S{f) > —oo. If EV^ < oo, then comparison with the standard Gaussian density 
and again Jensen’s inequality yields iS(V) < oo. Particularly, the entropy of a log- 
concave random variable is well defined and finite. Recall that a random vector in 
M" is called log-concave if it has a density of the form e~'^ with k’ : E"" —^ (~oo, J-cxo] 
being a convex function. 
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The entropy power inequality (EPI) says that 

+ ( 2 ) 

for independent random vectors X and Y in M” provided that all the entropies 
exist. Stated hrst by Shannon in his seminal paper [22] and hrst rigorously proved 
by Stam in [23] (see also 0), it is often referred to as the Shannon-Stam inequality 
and plays a crucial role in information theory and elsewhere (see the survey US]). 
Using the AM-GM inequality, the EPI can be linearised', for every A G [0,1] and 
independent random vectors X, Y we have 

S{\fXX + VT^Y) > XS{X) + (1 - A)5(U) (3) 

provided that all the entropies exist. This formulation is in fact equivalent to 
(]2|) as hrst observed by Lieb in [20], where he also shows how to derive (jOD from 
Young’s inequality with sharp constants. Several other proofs of (jOj) are available, 
including rehnements [13] . na, I 2 S 1 , versions for the Fisher information m and 
recent techniques of the minimum mean-square error 123- 

If X and Y are independent and identically distributed random variables (or 
vectors), inequality (jOJ) says that the entropy of the normalised sum 

Xa = \/AX + ^/^^Y (4) 

is at least as big as the entropy of the summands X and Y, S{X\) > S{X). It is 
worth mentioning that this phenomenon has been quantihed, hrst in 1121. which has 
deep consequences in probability (see the pioneering work [1] and its sequels BE] 
which establish the rate of convergence in the entropic central limit theorem and the 
“second law of probability” of the entropy growth, as well as the independent work 
[T8] . with somewhat diherent methods). In the context of log-concave vectors. Ball 
and Nguyen in [5] establish dimension free lower bounds on iS(Xi/ 2 ) — ‘5(X) and 
discuss connections between the entropy and major conjectures in convex geometry; 
for the latter see also m- 

In general, the EPI cannot be reversed. In [7], Proposition V.8, Bobkov and 
Christyakov hnd a random vector X with a hnite entropy such that iS(X -|-Y) = cxo 
for every independent of X random vector Y with hnite entropy. However, for log- 
concave vectors and, more generally, convex measures, Bobkov and Madiman have 
recently addressed the question of reversing the EPI (see EE]). They show that 
for any pair X, Y of independent log-concave random vectors in M", there are linear 
volume preserving maps Ti,T 2 : —)■ such that 

gl5(Ti(X)+T2(V)) < 


2 




where C is some universal constant. 


The goal of this note is to further investigate in the log-concave setting some 
new forms of what could be called a reverse EPI. In the next section we present our 
results. The last section is devoted to their proofs. 
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2 Main results and conjectures 

Suppose X is a symmetric log-concave random vector in M”. Then any projection 
of X on a certain direction v G M”, that is the random variable (X, n) is also log- 
concave. Here (•, •) denotes the standard scalar product in If we know the 
entropies of projections in, say two different directions, can we say anything about 
the entropy of projections in related directions? We make the following conjecture. 

Conjecture 1. Let X be a symmetric log-concave random vector in Then the 
function 



0 n = 0 


defines a norm on M"’. 

The homogeneity of Nx is clear. To check the triangle inequality, we have to 
answer really a two-dimensional question: is it true that for a symmetric log-concave 
random vector (X, Y) in we have 


,S{X+Y) ^ g5(X) g5(y)7 


(5) 


e 


Indeed, this applied to the vector ((m,X) , (n,X)) which is also log-concave yields 
Nx{u-\-v) < Nx{u) Nx{v). Inequality ([5]) can be seen as a reverse EPI, cf. ([2]). It 
is not too difficult to show that this inequality holds up to a multiplicative constant. 


Proposition 1. Let (X, Y) he a symmetric log-concave random vector on R^. Then 

^SiX+Y) < g _ 
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Proof. The argument relies on the well-known observation that for a log-concave 
density /: M —> [0,-l-cxo) its maximum and entropy are related (see for example 
0 or HO]), 

-ln||/||oo<5(/)<l-ln||/|U. (6) 


Suppose that w is an even log-concave density of (X, Y). The densities of X, Y 
and X + Y equal respectively 

f{x) = J w{x,t)dt, g{x) = J w{t,x)dt, h{x) = Jw{x — t,t)dt. (7) 

They are even and log-concave, hence attain their maximum at zero. By the result 
of Ball (Busemann’s theorem for symmetric log-concave measures, see [3]), the 
function ||a:||^ = (f w(tx)dt)~^ is a norm on Particularly, 

11 1 


h(0) f w(—t,t)dt 

1 1 
+ 


— \Y 2 — ^i\\w Y ||ei| 
1 1 


Using 


/M;(t,0)df /M;(0,f)dt /(O) g{0) 

twice we obtain 


II 62 ||^u 

1 1 
- + 


oS{X+Y) 


< 


< e 


1 1 
- + 




□ 


Recall that the classical result of Aoki and Rolewicz says that a U-quasi-norm 
(1-homogeneous function satisfying the triangle inequality up to a multiplicative 
constant C) is equivalent to some K-semi-norm (k- homogeneous function satisfying 
the triangle inequality) for some n depending only on C (to be precise, it is enough 
to take K, = \\i2/ \\i{2C)). See for instance Lemma 1.1 and Theorem 1.2 in |19j . 
In view of Proposition [H for every symmetric log-concave random vector X in R” 
the function Nx{v)^ = with k = is equivalent to some nonnegative 

K-semi-norm. Therefore, it is natural to relax Conjectured] and ask whether there is 
a positive universal constant k such that the function Nx itself satisfies the triangle 
inequality for every symmetric log-concave random vector X in R"^. Our main result 
answers this question positively. 

Theorem 1. There exists a universal constant k > 0 such that for a symmetric 
log-concave random vector X in R"" and two vectors u,v E MP we have 

^kS((u+v,X)} ^ ^kS{(u,X)) ^kS{{v,X)) ^ 

Equivalently, for a symmetric log-concave random vector {X, Y) in R^ we have 

^KSiX+Y)) ^ ^kS{X) gK5(y)_ 

In fact, we can take k = 1 /5. 
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Remark 1. If we take X and Y to be independent random variables nniformly 
distribnted on the intervals [0, t] and [0,1] with t < 1, then ([9]) becomes < 1+t^. 
Letting t —)■ 0 shows that necessarily k < 1. We believe that this is the extreme 
case and the optimal valne of k eqnals 1 . 

Remark 2. Ineqnality ([9]) with k = 1 can be easily shown for log-concave random 
vectors {X, Y) in for which one marginal has the same law as the other one 
rescaled, say Y ~ tX for some f > 0. Note that the symmetry of {X, Y) is not 
needed here. This fact in the essential case of f = 1 was first observed in [TT]. We 
recall the argument in the next section. Moreover, in that paper the converse was 
shown as well: given a density /, the equality 

max{5(W + Y), X ^ f,Y ^ f} = S{2X) 

holds if and only if / is log-concave, thus characterizing log-concavity. For some 
bounds on iS(X ± y) in higher dimensions see [21] and [9]. 

It will be much more convenient to prove Theorem [1] in an equivalent form, 
obtained by linearising inequality fl9l) . 

Theorem 2. Let {X, Y) be a symmetric log-concave vector in R^ and assume that 
S{X) = iS(y). Then for every 9 G [0,1] we have 

s{ex + (1 - e)Y) < s{x) + - in{e^ -i- (i - e)^), (lo) 

where k, > 0 is a universal constant. We can take n = 1/5. 

Remark 3. Proving Conjecture [1] is equivalent to showing the above theorem with 

K = 1. 

Notice that in the above reverse EPI we estimate the entropy of linear com¬ 
binations of summands whose joint distribution is log-concave. This is different 
from what would be the straightforward reverse form of the EPI ([3]) for indepen¬ 
dent summands with weights y/X and y/1 — A preserving variance. Suppose that 
the summands X, Y are independent and identically distributed, say with hnite 
variance and recall (jl]). Then, as we mentioned in the introduction, the EPI says 
that the function [0,1] 3 A —?■ iS(AfA) is minimal at A = 0 and A = 1. Following this 
logic, reversing the EPI could amount to determining the A for which the maximum 
of this function occurs. Our next result shows that the somewhat natural guess of 
A = 1/2 is false in general. 

Proposition 2. For each positive Aq < 2 ( 2 + 72 ) ® symmetric continuous 

random variable X of finite variance for which iS(Xao) > iS(Xi/ 2 )- 


5 




Nevertheless, we believe that in the log-concave setting the function A i—)■ iS(Xa) 
should behave nicely. 

Conjecture 2. Let X and Y be independent copies of a log-concave random vari¬ 
able. Then the function 

A ^ S{\f\X + Vl - XY) 

is concave on [0,1]. 


3 Proofs 

3.1 Theorems [1] and [2] are equivalent 

To see that Theorem [2] implies Theorem [T] let us take a symmetric log-concave 
random vector (X, Y) in and take 9 such that S{X/9) = S{Y/[1—9)), that is, 9 = 
e‘5(x)^^g5(x) _|_g5(y)^ g [0,1]. Applying Theorem [2] with the vector {X/9,Y/{l — 9)) 
and using the identity S{X/9) = iS(X) — In 6* = — ln(e‘^(^^ -f gives 

1 / pK,S{X) I „kS{Y) \ 1 

S(X + r) < S(X/0) + - In = - In . 

SO dl]) follows. 

To see that Theorem [T] implies Theorem [21 take a log-concave vector (X, Y) with 
iS(X) = iS(X) and apply ([9]) to the vector {9X, {1 — 9)Y), which yields 

S{9X + (1 - 9)Y) < - In [9^e^^^'> + (1 - 

K 

= S{X) + -\n{9^ + [l - 9Y). 

K 


3.2 Proof of Remark [2] 

Let w : R^ —> [0, -|-oo) be the density of such a vector and let /, g, h be the densities 
of X, F, X -|- X as in ([7]). The assumption means that f{x) = tg{tx). By convexity. 


5(X + F) = inf 


h In p, p is a probability density on 


Using Fubini’s theorem and changing variables yields 


— h Inp = — w{x, y) lnp(a; -|- y) dxdy 


= —9{1 — 9) w{9x, (1 — 9)y) \np{9x + (1 — 9)y) dxdy 
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for every 9 G (0,1) and a probability density p. If p is log-concave we get 


iS(X -I- F) < — 6*^(1 — 9) w{9x, (1 — 9)y) \np{x) dxdy 

— 9{1 — 9Y w{9x, {1 — 9)y)lnp{y) dxdy 

= — 6*^ y f{9x) lnp(a;)da; — (1 — 9^ j 5'((1 — 9)y') \np{y)dy 




9S{X) + (1 - 0)5(y) - 0 In 0 - (1 - 0)ln(l - 9). 


Since iS(F) = iS(X) -|-lnt = iS(X) -|-lnb^^ we thus obtain 

S{X + Y)< S{X) -\n9 = S{X) + ln(l + t)= In -1- . 

3.3 Proof of Theorem [2] 

The idea of our proof of Theorem [2] is very simple. For small 9 we bound the 
quantity S{9X -1- (1 — 9)Y) by estimating its derivative. To bound it for large 9, 
we shall crudely apply Proposition [H The exact bound based on estimating the 
derivative reads as follows. 

Proposition 3. Let {X,Y) be a symmetric log-concave random vector on M^. As¬ 
sume that S{X) = iS(F) and let 0 < 9 < 2 {i+e) • 


S{9X + (1 - 9)Y) < S{X) + 60(1 + e)9. 


( 11 ) 


The main ingredient of the proof of the above proposition is the following lemma. 
We postpone its proof until the next subsection. 

Lemma 1. Let tc : —)■ M+ be an even log-concave function. Define f{x) = 

f w(x, y)dy and 7 = / w(0, y)dy / / w{x, 0)da:. Then we have 



JJ fix) ’ J 

Proof of Proposition\^ For 9 = 0 both sides of inequality flTT]) are equal. It is 


therefore enough to prove that ■^Si9X -l- (1 — 6^)^) < 60(1 -|- e) for 0 < 0 < 2 {i+e) • 
Let fe be the density of Xe = 9X -|- (1 — 9)Y. Note that fe = where ipe is 
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convex. Let ^ = $0 and ^ = Fq. Then <l>e = —Fg/fe. Using the chain rnle we 
get 


Ts(9A' + (1 - e)Y) 


me(Xe) + mMXe){X - Y). 


Moreover, 

E$ 0 (Xe) = -¥.Fe{Xe)/fg{Xg) = - J Fe{x)dx 

= j fe{x)dx = 0 . 


Let Zg = {Xg, X — Y) and let wg be the density of Zg. Using Lemma d] with w = wg 
gives 




^(0X + (1-0)U) 




fejx] 

fe{x] 


ywg{x,y)dxdy < 3 O 70 , 


where jg = f wg(0, y)dy/ f wg(x, 0)dx. It snffices to show that jg < 2(1+ e) for 0 < 
^ < 2 (i+e) • Let w be the density of (X, y). Then wg(x, y) = w(x + (1 — d)y, x — 0y). 
To hnish the proof we again nse the fact that ||n|l^ = (f w(tv)dt)~^ is a norm. Note 
that 

^ fwg(0,y)dy ^ f w((l - e)y, -9y)dy ^ ||ei + e 2 |U 
f wg(x,0)dx fw(x,x)dx II (1 — 6 ')ei — 6 *e 2 ||«, 


Let f(x) = f w(x,y)dy and g(x) = f w(y,x)dy be the densities of real log-concave 
random variables X and V, respectively. Observe that by ([H]) we have 


WfV < < e||/|l-\ ||^ 7 ||-^ < < e||^||-b 

Since \\f\\^ = /(O)"^ = ||ei||^, || 5 (||"^ = = ||e 2 |U and 5(X) = 5(y), this 

gives e~^ < |lei||/||e 2 || < e. Thus, by the triangle inequality 

^ l|ci|U + ||e2|U 

(l-e)l|e,||„-9||e2|U 

^ (1-|-e)||ei||iu _ 1-|-e 

(1 — 6*)||ei||^ — 0e||ei||^ 1 — 6{1 + e) 

< 2(1+ e). 


□ 

Proof of Theoreml^ We can assume that 6 G [0,1/2]. Using Proposition [T] with the 
vector {6X, (1 — 9)Y) and the fact that iS(X) = iS(y) we get S{6X -l- (1 — 9)Y) < 











iS(X) + 1. Thus, from Proposition [3] we deduce that it is enough to hud k > 0 such 
that 

min{l, 60(1 + 6)9} < ln(r + (1 - 9)^), 9 e [0,1/2] 

(if 60(1 + e)6* < 1 then 9 < 2 {i+e) therefore Proposition [3] indeed can be used in 
this case). By the concavity and monotonicity of the right hand side it is enough to 
check this inequality at 9q = (60(1 + e))“^, that is, we have to verify the inequality 
< 9q + (1 — 9o)^. We check that this is true for k = 1/5. □ 


3.4 Proof of Lemma [T] 

We start off by establishing two simple and standard lemmas. The second one is a 
limiting case of the so-called Griinbaum theorem, see UTl and m. 


Lemma 2. Let f : 

by 

Then we have 


—)■ M+ be an even log-concave function. For ft > 0 define ag 

ap = sup{x > 0, f{x) > e"^/(0)}. 

1 


2 e ^ap < 


/(O) 


/ < 2(1 + /3 e ^)ap. 


Proof. Since / is even and log-concave, it is maximal at zero and nonincreasing on 
[0, oo). Consequently, the left hand inequality immediately follows from the deh- 
nition of ap. By comparing In / with an appropriate linear function, log-concavity 


-j3 — 

also guarantees that f{x) < /(0)e for \x\ > ap, hence 






f < 2apf{0) + 2 j /(0)e "“Mx = 2apf{0) + 2/(0)^e 


which gives the right hand inequality. 


□ 


Lemma 3. Let X be a log-concave random variable. Let a satisfy ¥ {X > a) < e 
Then EX < a. 

Proof. Without loss of generality assume that X is a continuous random variable 
and that P (X > a) = e~^. Moreover, the statement is translation invariant, so we 
can assume that a = 0. Let 6““^ be the density of X, where ip is convex. There 
exists a function of the form 


fj^x) = 


ax b, X > L 


-Fco, 


X < L 


such that "(/(O) = </9(0) and e“'^ is the probability density of a random variable Y 
with P (y > a) = e~^. One can check, using convexity of p, that EX < EX. We 
have 1 = f e~'^ = and e~^ = e~'^ = -e~^. It follows that aL = —1 

and we have EX < EX = „ (-^ + „) = 0. □ 
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We are ready to prove Lemma [H 

Proof of LemmaUi Without loss of generality let us assume that w is strictly log- 
concave and r(;(0) = 1. First we derive a pointwise estimate on w which will 
enable us to obtain good pointwise bounds on the quantity J yw{x,y)dy, relative 
to f{x). To this end, set unique positive parameters a and b to be such that 
r(;(a, 0) = e~^ = w{0,b). Consider I G (0,a). We have 

w{-l, 0) = w{l, 0) > w{a, 0)'/“w(0, 0)^-'/“ = 

Fix X > 0 and let y > ^x + b. Let I be such that the line passing through the points 
(0,6) and {x,y) intersect the x-axis at (—/,0), that is I = Note that I G (0,a). 
Then 


e ^ = w{0,b) > w{x,y)’’^^w{—l,0Y > w{x,y)^^^e 


-Ui-b/y) 


I y y—h 


hence 


w 


w{x,y)e “ y 


(x, y) < 0 ^^°“ ^ for a: > 0 and y > -x Pb. 


bjy 


Let X be a random variable with log-concave density y i—)■ w{x,y)/f{x). Let us 
take /3 = b + 61n(max{/(0), 6}) and 

6 

a = -X — b\nf{x) + [3. 
a 

Since / is maximal at zero (as it is an even log-concave function), we check that 

6 6 

a > -X — bln f{0) + f] > -x + b, 
a a 

so we can use the pointwise estimate on w and get 


w 


{x, y)dy < / e-y^'^dy = = 


e f{x) < e f{x). 


max{/(0),6} 

This means that P (X > a) < e~^, which in view of Lemma |3] yields 

1 /* b 

/ yw(x,y)dy = EX < a = —x — bln fix) + (3, for a; > 0. 
f{x) J a 

Having obtained this bound, we can easily estimate the quantity stated in the 
lemma. By the symmetry of w we have 

^ yw{x,y)dxdy = 2 ^ yw{x,y)dxdy. 

Jlp) JJx>0 J\p) 
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Since / decreases on [0, oo), the factor —f\x) is nonnegative for a; > 0, thus we can 
further write 

ywix^ y)dxdy < 2 f —f(x)(-x — b\nf{x) + /3]dx 
fix) Jo \a ) 

= V(0){-b In /(O) + /3) + 2 f f{x) (- - di 

= 2/(0).(l + ln "-y'-> )+^/^ + 2/(0)^ 

Now we only need to put the finishing touches to this expression. By Lemma H] 
applied to the functions x i—)■ w{x, 0 ) and y i—)■ w( 0 , y) we obtain 

b e , f w( 0 , v)dy 

and b/f{0) < e/2. Estimating the logarithm yields 

max{/( 0 ), 6 } max{/( 0 ), 6 } e 

/(O) ^ /(O) ^2- 

Finally, by log-concavity, 


w{x,y)dxdy > / \/w{2x^ 0 )tc( 0 , 2y)dxdy = - / \/ wfx^ 0 )dx / y/te( 0 , ?/)d|/ 


and 


y te(a;, 0 )dx< y/te( 0 , 0 ) J a/ ry(a;, 0 )dx = J ^/w{x, 0 )dx. 
Combining these two estimates we get 


/(O) = f w{0,y)dy < [ ^/w{0,y)dy < . 

y y jM;(a;, 0 )da; 


and consequently. 


/(0)6<|/(0)/(0)<2e/(0)^^^^ = 2e./,n. 


Finally, 


-fix] 
fix) 

and the assertion follows. 


yw{x, y)dxdy < (2e^ -f 5e -|- 1)7 / w 


□ 


3.5 Proof of Proposition [2] 

For a real number s and nonnegative numbers a < J we define the following trape¬ 
zoidal function 


Kjy = I 


0 ifx<sora:>s-t-a-l-/3, 

X — s ifs<x<s-|-a, 

a ifs-|-a<a:<s-|-/5, 

s + a + /3 — X ifs + (3<x<s + a + /3. 
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The motivation is the following convolution identity: for real numbers a, a' and 
nonnegative numbers h, h' such that h < h' we have 

l[a,a+/i] * ■ ( 12 ) 


It is also easy to check that 

f = a/3- (13) 

Jr 

We shall need one more formula: for any real number s and nonnegative numbers 
A, a, (3 with a < (3 we have 

I{A, a, /3) = [ AT^p In {AT^^) = Aa(3 In (Aa) - ( 14 ) 

Fix0<a<6 = a + h. Let X be a random variable with the density 
fix) = ^ (l[-b,-a]((E) + l[a,fe](x)) . 

We shall compute the density fx of X^. Denote u = \/A, v = \/l — A and without 
loss of generality assume that A < 1/2. Clearly, f\ix) = (-) -k 1/ (-) (a:), so by 

m we have 


fxix) kc a] T lii[a,b] li)[—b,—a] 

T !«[—b,—a] lt![a,b] T ln[a,b] li;[a,b]^ (•^) 


{2hYuv 

_ ( rp-iu+v)b/ \ rpua-vbf \ I rp-ub+va ( \ I rp{u+v)a, ^ 
~ \ J^uh,vh \X) “T ^uh^h \X) “T ^uh,vh ) -T ^ uh , vh \.X ^ 


{2h)'^uv' 


Ti 


T 2 


T 3 


Ti 


This symmetric density is superposition of 4 trapezoid functions Ti, T 2 , T 3 , T 4 which 
are certain shifts of the same trapezoid function Tq = The shifts may overlap 

depending on the value of A. Now we shall consider two particular values of A. 


Case 1: A = 1/2. Then u = v = l/\/2. Notice that Tq becomes a triangle looking 
function and T 2 = T 3 , so we obtain 


Mx) 


1 


/ rTi—hy/2 I cy'^n—hj'spl . rjia's/2 

\ hl^,hlV2 hlV2,h/V2 


(x). 


If h/x/2 < a\f2 then the supports of the summands are disjoint and with the aid of 
identity flTT)) we obtain 


5(Xi/2) = -21 


( 1 ^ 


-I 


(L A Jl\ 


ln( 2 h) + 


12 





Case 2: small X. Now we choose A = Aq so that the supports of Ti and T 2 intersect 
in such a way that the down-slope of Ti adds up to the up-slope of T 2 giving a flat 
piece. This happens when —b{u + v) + vh = ua — bv, that is, 


1 — Af 


An 


V a + b 
~ ^ — h — ^ 

u li h 


(15) 


The earlier condition a/h > 1/2 implies that Aq < 1/5. With the above choice for 
A we have Ti -|- T 2 = > hence by symmetry 


h 


( rp — b(u+v) 
^ uh,2vh 


I rp—ub-\-va \ 
‘ uh,2vh j 


1 

{2hyuv' 


As long as —ub + va > 0 , the supports of these two trapezoid functions are disjoint. 
Given our choice for A, this is equivalent to v/u > b/a = 1 + h/a = 1 - 1 - 2 / {v/u — 1), 
or putting v/u = a/I/Aq — 1, to Aq < 2 ( 2 +y/ 2 ) ' < 1/5 and we get 


We have 


5(A,J-5(Xi/2)=ln2 


1 

2 


-h In v^l - Aq + 


1 / -^0 

4 V 1 — Aq 


We check that the right hand side is positive for Aq < 2 ( 2 + 72 ) ' Therefore, we have 
shown that for each such Aq there is a choice for the parameters a and h (given by 
fir5|) i. and hence a random variable X, for which iS(Xao) > iS(Xi/ 2 )- 
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